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Abstract 



The three-state Ising neural network with synchronous updating and variable dilu- 
tion is discussed starting from the appropriate Hamiltonians. The thermodynamic 
and retrieval properties are examined using replica mean-field theory. Capacity- 
temperature phase diagrams are derived for several values of the pattern activity 
and different gradations of dilution, and the information content is calculated. The 
results are compared with those for sequential updating. The effect of self-coupling 
is established. Also the dynamics is studied using the generating function technique 
for both synchronous and sequential updating. Typical flow diagrams for the over- 
lap order parameter are presented. The differences with the signal-to-noise approach 
are outlined. 
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1 Introduction 



The dynamics and the storage and retrieval properties of multi-state attractor 
neural networks have been studied over some time now and numerous results 
arc available (sec, e.g., [1] and references therein). The majority of the results 
obtained on the storage and retrieval properties concern sequential updating 
of the neurons. 

Recently, it has been realized that synchronous updating of the spins in dis- 
ordered systems can lead to different physics [2]- [7]. For example, for binary 
spins, it is known that the phase diagram of the sequential and synchronous 
Little-Hopfield neural network [8,9] in the replica-symmetric approximation 
are different [6], whereas the phase diagrams of the Sherrington-Kirkpatrick 
model [10] are the same [7]. For the three-state Ising ferromagnet the same 
stationary solutions appear except for negative couplings, while for the Blume- 
Emery-Griffiths ferromagnet the phase diagram for synchronous updating is 
much richer [2]. 

For the three-state Ising neural network the possible different physics between 
sequential and synchronous updating has not yet been studied. Looking at the 
literature we see that using sequential updating the equilibrium properties of 
the Q-Ising model for the fully connected architecture have been studied in 
[11] and [12] making a replica symmetric ansatz. The results for the extremely 
diluted architecture appeared in [13] and have been extended later to the whole 
dilution range in [14]. The layered architecture with variable dilution has been 
examined recently [15]. Nothing has been reported on the equilibrium prop- 
erties for the recurrent architectures, however, when synchronous updating 
is used. On the other hand, concerning dynamics no calculations were done 
for the Q-Ising model with sequential updating. For synchronous updating 
the work of [16] on the exactly solvable extremely diluted asymmetric Little- 
Hopfield model has been extended to the Q- Ising model in [17]. Later on, the 
dynamics for the fully connected and the extremely diluted symmetric Q-lsing 
architecture have been solved in [18] and, respectively, [19]. The latter studies 
make use of the so-called signal-to- noise analysis (see, e.g., [1] for references 
on this method). An extension to the whole dilution range, in analogy with 
[14] has not yet been given. 

The aim of this work is precisely to fill the gaps mentioned above with a 
report on the study of the Q — 3-Ising network with synchronous updat- 
ing and variable dilution and a detailed comparison of the results obtained 
with the ones for sequential updating. First, the thermodynamic and retrieval 
properties are examined using replica symmetric mean-field theory. Capacity- 
temperature phase diagrams are derived for several values of the pattern activ- 
ity and different gradations of dilution. Apart from the appearance of cycles 



2 



the asymptotic behaviour is almost identical to the one for sequential up- 
dating. The spin-glass region is visibly enhanced, while the retrieval region, 
however, is only marginally enhanced. Only the addition of self-couplings can 
enlarge the retrieval region substantially, especially in the case of strong dilu- 
tion. A calculaton of the information content shows that both for synchronous 
and sequential Tipdating the three-state networks are robust against the in- 
terference of static noise coming from random dilution. Next, the dynamics 
of the model is studied using the generating function technique [20,21]. As an 
illustration some typical flow diagrams for the overlap order parameter are 
presented. It is possible to extract the result for sequential updating from the 
one for synchronous updating. As in the Hopfield model [22] one can argue 
that the signal-to-noise analysis used before in the literature is a short mem- 
ory approximation correct up to the third time step. And it can also be shown 
that the signal-to- noise analysis can be made exact. 

The rest of the paper is organized as follows. In Section 2 the three-state Ising 
neural network with synchronous updating and variable dilution is introduced. 
Section 3 reports on the replica symmetric mean field theory calculation of the 
free energy and the fixed-point equations for the relevant order parameters. In 
Section 4 the phase diagrams and retrieval properties are discussed for arbi- 
trary temperatures as a function of the gain parameter, the amount of dilution 
and the strength of the self-coupling. Section 5 discusses the dynamics for the 
model using the generating functional analysis and comments on the relation 
with the signal-to-noise analysis. In Section 6 some concluding remarks are 
given. Finally, the appendix presents the explicit saddle-point equations. 



2 The three-state Ising neural network 

Consider a network of N neurons, cr = {ai, a^}, which can take values from 
the set S = {—1,0, 1}. In this network we want to store p = aN patterns, 
= 1, . . . , and /i = 1, . . . ,p. They are supposed to be independent 
identically distributed random variables (i.i.d.r.v.) with respect to i and /i, 
drawn from a probability distribution given by 

p(er) = a5(i-(em + (i-a)5(er), w 

with a the pattern activity defined by the expectation value 

mn') = « ■ (2) 

The neurons are updated synchronously according to the transition probability 
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N 



W [(T{t + l)\a'{t)] = l[Pr iai{t + 1) = s e S\a'{t)) 



i=l 



Pr (cTj(t + 1) = s e S\(T'{t)) 



(3) 
(4) 



with P the inverse temperature and ei(s|cr) an effective single site energy 
function given by [11] 



ei{s\a) = - 



1 



hiicr)s — bs^ 



(5) 



where b is the gain parameter of the system suppressing or enhancing the zero 
state of the neurons. The random local fields are defined by 



N 



The couplings J^^ are taken to be of the form 



(6) 



jc _ ^ij 



Jij -I 



where the probability distribution of the {cjj} is given by 

P(qj) = c5{cij - 1) + (1 - c)5{cij) . 



(7) 



(8) 



Hence, they allow for a diluted architecture. The Jij are determined via the 
Hebb rule 

J^3 = j^tm (9) 



In order for the model to satisfy detailed balance (see,e.g., [21,23]), the dilution 
has to be symmetric (qj = Cj,). In the case of extreme dilution, when c = 0, 
the average number of connections per neuron, cN , is still infinite 



lim — = . 

N-*oo cN 



(10) 



Finally, wc recall that the detailed balance property for synchronous updating 
is not destroyed by the presence of self-couplings, i.e., couplings of the form Jfj. 
Hence, wc do allow for this type of couplings and redefine J^^ — > JoJ^^ = a Jo, 
with Jo a parameter and a = p/cN the capacity. 



The long-time behaviour is governed by the Hamiltonian [2] 



N 



Hia) 



J2exp{P[hi{a)s-bs^]) 

.s£S 



N 



i=l 
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In addition, when evaluating traces over spins in the calculation of, e.g., the 
partition function, one realizes that the system is equivalent to one with a 
Hamiltonian involving a set of duplicate Ising spins (see, e.g., [2,6,23]), which 
can be written as 

H{a, r) = - ^ J:^a,T, + b ^[a,^ + ] (12) 
such that ^exp[-(3H{(T)] = "^Tr exp[-f3H {a, r)]. 

It is well-known that the equilibrium behaviour can be fixed-points and/or 
cycles of period 2, i.e., ai{t) — ai{t + 2), Vi. 

In the next Section we study the thermodynamic and retrieval properties of 
this model starting from the free energy. 



3 Replica mean-field theory 

In order to calculate the free energy we use the replica method as applied 
to dilute systems [13], [14], [24]- [27]. Since this method is really standard by 
now, at least for sequential updating, we refrain from giving any detailed 
calculations but concentrate on the main results and the differences between 
sequential and synchronous updating. Indeed, some complications arise due 
to the symmetry between the two types of spins in the Hamiltonian. 

Starting from the replicated partition function, performing the dilution aver- 
age and the average over the condensed (/x = 1) and non-condensed (/x > 1) 
patterns we obtain for the replicated free energy density 

OiC 

fn^amrh + —Trlog{I- pA) 

-(l-c)^Tr (qp + r^) -a{Jo-c)Tr{r) 

+ ^Tr(qrqr + pp+2rrt)-i^logTrexp(-/3i^(o-,T))^^ , (13) 

with 

H{a, r) = -^{mcr + far) - — (aqa^ + rpr^ + 2<rfT^) - pb (<r^ + r^) . 

^ (14) 
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The symbol I denotes the unit matrix in rephca space and 

(q ir 
IS —p 

Hereby the usual order parameters are introduced as replica matrices {n is the 
replica index) with elements 

< = ^Ee^r. ^^ = ^Eerrr, (is) 

i i 
1 1 

i i 

^a/3 = ^E^r^f> «a/3 = ^E^>f- (17) 

i i 

Their conjugate variables are denoted with a hat. The free energy should be 
interpreted as being extremised with respect to m, rh, q, p and r. We remark 
that the corresponding result for sequential dynamics (see, e.g., [12,13,14]) is 
recovered by assuming cr = t and rcscaling the temperature with a factor 2. 
Furthermore, we notice that compared with sequential updating, the replicated 
free energy (13) is more involved. It is clear that a priori the matrices appearing 
in this expression are not necessarily symmetric. 

As mentioned in the introduction it is known that synchronous updating can 
lead to two-cycles as stationary solutions. Results for the Hopficld model 
[28,29] and the Blume-Emery-Griffiths model [30,31] show that such cycles 
do not appear in the retrieval region of the corresponding phase diagrams. 
Therefore, cycles have been neglected in the replica calculation of the re- 
trieval properties of these models. In analogy, for the three-state Ising model 
discussed here we make a similar ansatz. We neglect cycles in the sequel of 
the replica calculation and we assume that the two sets of spins behave in a 
completely symmetric way. Consequently, q = p, r = r\ and similarly for 
the conjugate variables. The same symmetry apphes to m and rh. The free 
energy then becomes 

/ = am^ + ^Trlog((/-/?r)^-/?V) 

_(1 _ c)^Tr {q' + r') - a{J, - c)Tr (r) 

+a(3T^ {qq + rr)-^ (log IV exp (-(3H{a, r)) ^ , (18) 
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with 

H{o-,t) = -^m{a+T)-^(aqa^ + TqT^ + 2arT^)-pb(a-^ + T^) . (19) 

Next, we take the rephca symmetry (RS) ansatz 

ma=m , qap = qi , Qaa = qo , rap=ri , raa = r , (3 (20) 

and similarly for the conjugated variables. Due to the non-cycle ansatz, we 
have in addition 

ri = r^fs = Qap = qi (21) 
such that the RS free energy reads 



2 ac . 



f^am +^log 



(1 - Xrf - X' 



q 

ac- 



1 - Xr - X 



-(1 - c)^ (^^0 - + r^) + o:i3 {qoqo - 2qiqi + fr) 
+a{c- Jo)r-^Qvz\ogTrexp[-(3H{a,T\z))^ , (22) 



with the effective Hamiltonian 

H{a, t\z) = - (^^m + sja^iz^ {a + t) + [h - ^ax^ (a^ + r^) - aXr^-r (23) 

and Vz the gaussian measure Vz — (i2;(27r)~^/^ exp(— z^/2). We have also 
defined the susceptibilities 

X = /3(go - qi) , Xr = P{r - qi) , (24) 
and their conjugate expressions 

X = m - qi) , Xr = /3(r - qi) • (25) 

The phase structure of the network is then determined by the solution of the 
following set of saddle-point equations 

m=-^(ijvz {a)}j^ , r^l^jvz {ar) }j ^ , (26) 
J-Dzia')^) , q, = ^jvz{af^ , (27) 



where the average {■) ^ is defined with respect to the effective Hamiltonian (23) 
and 
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qi = qi (1 - c) + c 



1 



(28) 



(1 - Xr - X)^ 



X = (1 - c)x + C' 



X 



(29) 



Xr = (1 - c)Xr + C 




(30) 



Compared with sequential updating [12,13,14] we notice the extra equations 
for r and Xr expressing that a and r can be affected differently by thermal 
fluctuations and the fact that the equations for the conjugate parameters are 
different. In the appendix we present the explicit forms for (26)- (27). 



4 Phase diagrams and retrieval properties 

First, we look at the special case of low loading (a = 0). In that case the 
effective Hamiltonian (23) simplifies to 



which practically means that the two spin variables occurring in the expression 
for the free energy (22) become independent yielding /par = 2/seq as found 
before for other models [2,32,33]. Consequently, the saddle point equations 
are the same for synchronous and sequential updating and both yield the 
same stationary states. An explicit calculation shows that the low loading 
results correspond to those of the 3-lsing ferromagnet. For the relevant phase 
diagram we refer to [2] (Fig. 2 for J > 0). 

Next, we turn to finite loading and solve the saddle point equations (26)- 
(30) numerically for arbitrary temperature T. We present the phase diagrams 
for some representative values of the parameters c, b and Jo- We focuss on 
uniformly distributed patterns (a = 2/3). Results for sequential updating of 
the network are included for comparison. 



In Figure 1 we present the RS a—T phase diagrams with (Jq = 1) and without 
(Jo = 0) self-couphng for the fully connectivity architecture (c = 1) and gain 
parameter b — 0.2 and b — 0.5. The retrieval transition is discontinuous in all 
cases. For a fixed T, the retrieval capacity of the synchronously updated net- 
work with self-coupling is slightly larger than the one for the network without 
self-coupling, and both are slightly larger than the one for the sequentially 
updated network. However, the enhancement stays marginal, also for growing 



H{a, t\z) = -Cm{a + r) + 6(a^ + r^) , 



(31) 
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Fig. 1. The RS a — T phase diagram for the 3-Ising network with c = 1, a = 2/3, 
h = 0.2 (a) and h = 0.5 (b). SoUd (dotted) Unes present synchronous updating for 
Jo = (Jo = 1-0). Dashed hnes are for sequential updating. The retrieval state is 
stable below the thick lines. The spin glass state is stable at the left of the thin 
lines. 

self-coupling. The spin glass transition is always continuous. For h = 0.5, con- 
trary to 6 = 0.2, the spin glass phase is not stable at small a. But the retrieval 
phase is stable. This means that for b — 0.5, small a and low T the retrieval 
phase co-exists only with the paramagnetic phase, and not with the spin glass 
phase. 




Fig. 2. The same as Figure 1, but for the diluted network with c = 0.01. 

In Figure 2 we show the RS phase diagrams for the symmetrically diluted 
networks with c — 0.01. The other network parameters are kept identical to 
those in Figure 1. The retrieval (spin-glass) transitions remain discontinuous 
(continuous). The enhancement of the retrieval capacity is again marginal for 
the network with synchronous updating and without self-coupling, compared 
to the one for sequential updating. However, increasing the self-coupling shows 
a substantial improvement, except for a — 0. Also the spin-glass region is 
visibly enlarged in that case. The remark concerning the stability of the spin- 
glass phase for b = 0.5 and low T also applies to the diluted network, but 
with a small change: one remarks (see the bottom left corner of Figure 2 
(b)) that the spin-glass phase becomes stable at small a and low T, although 
there remains a region where only the retrieval and paramagnetic phases are 
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stable. Finally, wc notice a strong re-entrant behaviour in the retrieval region. 
This is related to the replica-symmetric approximation and is also seen in 
the Hopfield model [24,25]. Consequently, we conjecture that the fact that for 
b — 0.5, e.g., the maximal critical capacity for the network with self-coupling 
is larger compared to the one for the network without self-coupling, is an effect 
of this approximation. 




Fig. 3. The same as Figure 1, but for the extremely diluted network with c = 0. 
The curves for the sequentially and synchronously updated network without self 
coupling coincide. 

The RS phase diagrams for the extremely diluted symmetric (c = 0) network 
are shown in Figure 3. The other parameters are kept identical to those in 
Figures 1 and 2. The results for sequential and synchronous updating without 
self-coupling coincide. All transitions are continuous. Again, we notice a strong 
re-entrance behaviour in the retrieval region, in agreement with earlier results 
for this extremely diluted limit [13]. Increasing the self-coupling makes the 
synchronously updated network more robust against temperature, although, 
as expected, it has no effect on the critical temperature at zero a. The re- 
entrance point is reached for the same value of a. 



Finally, we briefly study the robustness of these three-state networks against 
the interference of static noise coming from random dilution. In Fig. 4 we 
show the information content of the model, being the product of the load- 
ing capacity and the mutual information [34], for synchronous updating and 
several amounts of dilution c with and without self-coupling. 

We see that for the fully connected network (c = 1.0, left figure), the results 
for Jq = and Jq = 1 do practically coincide, in agreement with Fig. 1. We 
remark that for b=0.2, two solutions co-exist at small a {0 < a < 0.007). One 
of them corresponds to perfect retrieval, with m — 1.0, qi = qo = a,x — 0. 
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Fig. 4. Information content i as a function of the loading capacity a for the 3-Ising 
model with synchronous updating at T = with uniform patterns (a = 2/3), two 
values of 6, with and without self-coupling and c = 1.0 (a) and 0.01 (b). 




Fig. 5. Information content % as a function of the loading capacity a for the 3-Ising 
model with sequential updating, uniform patterns, h = 0.5, T = 0, and c = 0.01, 
0.1 and 1.0. 



The corresponding information content is very close to that for h = 0.5. For 
the diluted network (c = 0.01, right figure), in agreement with Fig. 2, self- 
coupling mostly leads to a higher information content for the optimal gain 
parameter b — 0.5. (Again, for b — 0.2 there exist two solutions for small a 
but the difference is very small and can hardly be seen on the scale of the 
figure.) 

Next, by comparing with Fig. 5 for sequential updating, one notices that 
the results for sequential and synchronous updating (without self-coupling) 
are almost coincident. In all cases, we find that the quality of the retrieval 
properties is affected very little, unless the amount of dilution is high. 
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5 Dynamics 



As mentioned in the introduction most studies in the hterature on the dynam- 
ics of the Q-Ising model are based upon the signal-to-noise analysis. Except 
for the extremely diluted asymmetric and layered architectures, which can be 
solved exactly in closed form, the dynamics for the other architectures, only 
examined for synchronous updating, is obtained in the form of a recursive 
scheme. Recently, by a comparison with the generating functional analysis 
(GFA), it has been found [22] for the Hopfield model that the apphcation of 
this method in the study of the dynamics involves a short-memory approx- 
imation implying that the results are only exact up to the third time step, 
although they stay very accurate in the retrieval region for further time steps, 
but not so in the spin-glass region. It has also been shown that the signal-to- 
noise analysis can be made exact, leading to the same results as the generating 
functional analysis. 

Therefore, it is interesting to reconsider the dynamics for the Q — 3-state 
Ising model using this generating functional technique, which was introduced 
in [20] to the field of statistical mechanics and, by now, is part of many text- 
books. We closely follow the derivation in [22], extend it to variable dilution 
and indicate the differences for the model at hand. Both sequential and syn- 
chronous updating are discussed. In fact, the discussion is made for general 
Q. Since the method itself has become rather standard, we restrict ourselves 
to a presentation of the main arguments. 

The idea of the GFA approach to study dynamics [20,21] is to look at the 
probability to find a certain microscopic path in time. The basic tool to study 
the statistics of these paths is the generating functional 

m = E ^[^(0)' ■ ■ ■ ' n n e-^^^(*>'(*') (32) 

<T(0),...,<T(t) i=lt'=0 

with P[cr(0), . . . , cr{t)\ the probability to have a certain path in phase space 
P[cr(0), . . . , a{t)] = P[am H W[a{t' + l)\cT{t')] (33) 

t'=0 

and W[(T{t' + l)\<T{t')] the transition probabilities from <t' to cr. Synchronous 
updating is expressed by (recall eq. (4)). 

W[<r(t + l)|<r(t )] - n ■ae.piPa.AaHm ' ' 

where ei{ai{t' + l)|cr(t')) now includes a time-dependent external field 9i{s) in 
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order to define a response function 

ei{ai{t' + l)\cr{t')) = - ^^hi{cT{t'))a{t' + 1) - b{a{t' + l))^] + e,{t') . (35) 



One can find all the relevant order parameters, i.e., tiie overlap m{t), the 
correlation function C{t,t') and the response function G(t,t')j by calculating 
appropriate derivatives of the above functional (32) and letting = {ipi} tend 
to zero afterwards 



G{t,t')=t hm -y: 



1 ^ S^Z[ij^] 



c{t,t')=- hm -y: 



(36) 
(37) 
(38) 



A difference with the Little- Hopfield model [22] is the presence of the factor 1/a 
in (36). First, due to the proper scaling of the couphngs with this factor (recall 

eq. (9)) the average over the non-condensed patterns does not introduce an 
extra factor. Secondly, in the saddle point, terms containing this extra factor 
vanish. As a consequence, the factor 1/a does not appear explicitly in the 
expressions at all. The only point to keep in mind is the occurrence of the 
term proportional to the factor h in the dynamics (recall eq. (5)). 

Another difference with respect to the treatment in [22] is that one needs 
to average over the dilution. This is done before averaging over the non- 
condensed patterns by using the fact that the diluted couplings J?, are of 
order 0{{cN)-^/^) and that the Jij ~ Oi.N-^''^). Noting that the distribution 
for the dilution eq. (8) is i.i.d.r.v. for i < j and expanding the exponential 
containing the J^j up to order 0{N~^^'^) makes this average then straightfor- 
ward. 

In the thermodynamic limit one expects the physics of the problem to be inde- 
pendent of the quenched disorder and, therefore, one is interested in derivatives 
of Z['0], whereby the overline denotes the average over this disorder, i.e., over 
all pattern realizations. This results in an effective single spin local field given 

by 

t-i 

h{t) = ^ m{t) + aJ2 Rit, t') a{t') + Va7]{t) (39) 

t'=0 

with r]{t) temporally correlated noise with zero mean and correlation matrix 
D = c(J-G)-^C(J-G^)-^ + (l-c)C (40) 
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and the retarded self-interactions 



R=c(/-G)-^ + (l-c)G + (Jo-c)/. (41) 
The order parameters defined above can be written as 



m{t) = {{{^a{t))J , (42) 
C{t,t') = {{{a{t)a{t'))J , (43) 

The average over the efi^ective path measure (•) is given by 

(/), = Tr{.(i),...,.(,)} / drjPiri) P{ct\ii) f , (45) 
where drj = lit' v{t') with 



/ioTr (exp(/5a(f + l)/i(f)-/36a2(t' + l))) ^ ^ 

P(r7) = ^i=exp(-i |: 7i{t')B-\t',t")v{t")] . (47) 

V ^ t',t"=0 / 



^det(27rD) 



where /i(t') = C,fn{t') + aJ^pRit'^p) <^{p) + ^(^')- The average denoted by the 
double brackets in (44) is over the condensed pattern and initial conditions. 
The set of eqs. (39)- (41) and (45)- (47) represent an exact dynamical scheme 
for the evolution of the network from which all relevant order parameters can 
be obtained at all time steps. 

The order parameters are given by (42)- (44). To acquire a more intuitive 
expression for the response function we note that also 

We remark that G{t' ,t") = for t' < t" and D{t' ,t") = D{t",t') and that for 
all t' < t 



Git,t')^(3{{{a{t) 



Traexp(/5e,(fT,(t' + l)|cr(t'))) 
a(t' + 1) - ^ 



Trexp (l3aei{a\a{t'))) 
where h{t') appearing in is given by (39). 



(49) 
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For sequential updating we have to start from the stochastic process 

Ps+i{^)=J2^s[cT;cr']ps{cT') (50) 

with ps+i{cr) the probabihty to be in a state a at time s + 1 and Ws[cr; cr'] 
given by 

Ws[(T] (t'] = {'wM^a;(T' + Wi{Fia)S(r,Gi(T' + Wi{Gia)Sa,Fi(T'} , (51) 

i 

with the shorthand Wi{a) = Pr{cri(s + 1) = ai\cr{s)} and where Fj and Gi are 
cychc spin-flip operators between the spin states. Each time step a randomly 
chosen spin is updated. In the thermodynamic limit the dynamics becomes 
continuous because the characteristic time scale is A^~^. The standard pro- 
cedure is then to update a random spin according to (4) and (5) with time 
intervals A that are Poisson distributed with mean A^^^ . We can then write 
a continuous master equation in the thermodynamic limit 



—Psicr] = lim — 

ds ^ ' A^o A 



(52) 



■■Y{{wi{a) - 1)ps{<t) + Wi{Fi(T)ps{Fi(T) + Wi{Gi<T)ps{Gi(T)} 



In that case the effective path average reads 

= ldrjP{ri)[f]rj, (53) 

where [f]ri is an average over the (effective) stochastic process conditioned 
to the noise rj generated by the dynamics (53) and the distribution P{r]) is 
Gaussian with correlation matrix D 

Pin) = , ^ exp (~ I dt'dt"ri{t')-D-'{t'X)r,{t")) . (54) 
^det(27rD) V 2i J 



This result is very similar to the one for synchronous dynamics (recall eq. 47) . 
The main reason is that one does not need the explicit form of the transition 
rates of the Markovian process in order to derive the effective path average. If 
only the initial conditions factorize over the site index i then all sites become 
independent in the thermodynamic limit. In general, this is a characteristic 
feature of mean-field systems. 

Specialising this discussion to three Ising states {—1,0, -1-1} we have that for 
synchronous updating the trace in eq. (46) is given by 

Tr (exp{(3a(t' + l)h(t') - (3ba^(t' + 1)) = 1 + 2 cosh((3h(t')) exp (-(3b) . (55) 
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For sequential updating the spin-flip operators in eq. (51) are defined by 



Fi^{cr) = <l)(ai, cri_i, , (jj+i, ajv) 

GM<^) = FiiFi^a)) . (56) 

We have solved the dynamics numerically using the Eissfeller-Opper method 
[35] . The idea thereby is to replicate the system into M copies of the effective 
spin and let each of them evolve independently in time according to their own 
stochastic path with its own noise variable. Averages over the effective path 
measure (recall eqs. (45) and (53)) are replaced by averages over the ensemble 
of copies for large M. We have taken M — 10^. 





Fig. 6. The overlap m as a function of time using the Eissfeller-Opper algorithm 
with 10^ samples for the fully connected (c = 1, top) and diluted (c = 0.01, bot- 
tom) 3-Ising model with synchronous updating and uniform patterns (a = 2/3) for 
a = 0.01 and Jq = 0. The other model parameters are b = 0.2, T = 0.3 (top left), 
b = 0.5, T = 0.1 (top right), b = 0.2, T = 0.5 (bottom left) and b = 0.5, T = 0.2 
(bottom right). 



As an illustration we show some typical flow diagrams for the overlap order 
parameter in Figure 6 for some fully connected (c = 1, top figures) and diluted 
(c = 0.01, bottom figures) models. The model parameters are a = 0.01 and 
b = 0.2, T = 0.3 (top left), b = 0.5, T = 0.1 (top right), b = 0.2,T = 0.5 
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(bottom left) and b — 0.5, T — 0.2 (bottom right). Self-couplings are set to 
zero. 

Several remarks are in order. All situations shown are in the retrieval phase 
of the corresponding phase diagrams Figures 1 and 2. They all converge to 
the corresponding RS equilibrium results provided the initial overlap order 
parameter is large enough. This gives us also an idea of the basins of attraction. 
These basins are bigger for b = 0.2 since the relevant model parameters are 
chosen deeper in the retrieval region, i.e., closer to the line of thermodynamic 
stability. 

For completeness we end this Section on the discussion of the dynamics em- 
ploying the GFA approach with a couple of remarks. First, this technique can 
also be applied to asymmetric dilution (qj ^ Cji) and we then get for the 
correlation matrix and retarded self-interactions 



R = c(/-G)-^ + r(l-c)G + (Jo-c)7, (57) 
D = c(/-G)-^C(J-Gt)-^ + (l-c)C . (58) 

with the asymmetry factor F given by 

_ {CjjCji) - 

c(l-c) ■ 



Secondly, one can compare the GFA technique with the signal-to-noise analy- 
sis for the three-state Ising network [12,13]. This comparison is formally com- 
pletely analogous to the one for the Hopfield model discussed in detail in [22]. 
The only point at which one has to be careful is in deriving the recursion re- 
lations for the coloured noise rj. The diagonal of C, namely, is no longer equal 
to 1 but depends on time. Taking this into account one can take the results for 
the Hopfield model and extend it to Q > 2-lsing models. The outcome is that, 
even for general Q, the signal-to-noise analysis is a short memory approxima- 
tion to the real effective dynamics giving results correct up to the third time 
step. Like for the other models, this approximation is extremely good in the 
retrieval region but fails in the spin glass region. It is then a rather straightfor- 
ward exercise to extend the revisited signal-to-noise analysis, proposed in [22] 
to the Q-Ising case. Since the final results are completely equivalent to those 
of the GFA eqs. (39)-(41), we refrain from repeating further explicit details 
and refer to the work mentioned above ([22,29]). 
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6 Concluding remcirks 



We have studied the statics and dynamics of the three-state Ising neural net- 
work model with synchronous updating of the neurons and variable dilution. 
We have followed as closely as possible the discussion for the Hopfield model 

adapting the methods to the multi-state nature of the neurons. Although the 
equations that describe both statics and dynamics arc formally rather similar 
to those of the Hopfield model, we have seen that the physics behind it is quite 
different. 

We have examined the thermodynamic and retrieval properties for this model 
using replica symmetric mean-field theory and have made a detailed compar- 
ison of the results with those for sequential updating. Capacity-temperature 
phase diagrams are derived for several values of the pattern activity and dif- 
ferent gradations of dilution. Apart from the appearance of cycles the asymp- 
totic behaviour is almost identical to the one for sequential updating. The 
spin-glass region is visibly enhanced, while the retrieval region, however, is 
only marginally enhanced. Only the addition of self-couplings can enlarge the 
retrieval region substantially, especially in the case of strong dilution. A cal- 
culation of the information content shows that both for synchronous and se- 
quential updating the three-state networks are robust against the interference 
of static noise coming from random dilution. 

Concerning the dynamics, we have extended the generating functional analysis 
to the study of Q-state spins. As an illustration some typical flow diagrams 
for the overlap order parameter are presented in the case Q — 3. It is possible 
to extract the result for sequential updating from the one for synchronous 
updating. A comparison with the signal-to- noise approach is made. As for the 
Hopfield model one can argue that the signal-to-noise analysis used before in 
the literature is a short memory approximation correct up to the third time 
step. It can also be shown that this signal-to-noise analysis can be made exact. 
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Appendix 



We write down explicitly the saddle-point equations discussed in Section 3. 
Therefore we need the averages (cr)^, (cr^)^ and (ct)^ with respect to the 
effective Hamiltonian (23) 

{a)^ = ^ |sinh(2/3M) el^H-^+U)+^xr] ^ sinh(/3M) e^[-'+tx] | ^ (gO) 
(^^)^ = I |cosh(2/3M) e^^l-f+f x)+«x.] _ g/3[2(-6+f x)-ax.] I ^ (61) 

^^2^^^ I |cosh(2/3M) e^[2(-f+fx)+ax.] 

+ cosh(/3M) e^I-^+t*] + e^[2(-''+f x)-«x.] | ^ (62) 

with 

M = + . (63) 

Using the symmetry properties of these functions, we average over to ob- 
tain the saddle-point equations for the retrieval state of one pattern at finite 
temperature. We get 

j Vz (a)^ (m + yfa^iz) , (64) 

r = a j Vz (crr)^ (m + \fQ4iz) + [1 - a) j Vz {cft) ^ {^J aq^z) , (65) 
qo^ a J Vz (o"^)^ {m + \J aq-^z) + {I — a) j Vz (o"^)^ {\jocqiz) , (66) 

qi = ajvz [{a)f (m + ^/^iz) + {1 - a) J Vz [{a)f {^iz) , (67) 
that need to be solved together with the algebraic equations (28)-(30). 
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